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Abstract 

The  standard  state  space  solutions  to  the  Woo  control  problem  for  linear  time  invari¬ 
ant  systems  are  generalized  to  nonlinear  time-invariant  systems.  A  class  of  nonlinear 
W  co-controllers  are  parameterized  as  nonlinear  fractional  transformations  on  contractive, 
stable  free  nonlinear  parameters.  As  in  the  linear  case,  the  Woo  control  problem  is  solved 
by  its  reduction  to  four  simpler  special  state  space  problems,  together  with  a  separation 
argument.  Another  byproduct  of  this  approach  is  that  the  sufficient  conditions  for  Wo 0- 
control  problem  to  be  solved  are  also  derived  with  this  machinery.  The  solvability  for 
nonlinear  Wco-control  problem  requires  positive  definite  solutions  to  two  parallel  decou¬ 
pled  Hamilton- Jacobi  inequalities  and  these  two  solutions  satisfy  an  additional  coupling 
condition.  An  illustrative  example,  which  deals  with  a  passive  plant,  is  given  at  the  end. 


1  Introduction 


An  important  issue  in  control  system  synthesis  is  to  design  a  control  system  which  attenuates 
the  effects  of  external  disturbances  on  some  desired  signals.  The  standard  configuration  we 
will  consider  is 


where  G  is  the  generalized  plant  and  K  is  the  controller  to  be  designed;  w  is  the  vector  of 
exogenous  disturbance  inputs  and  u  is  the  vector  of  control  inputs;  z  is  the  the  vector  of 
outputs  to  be  regulated;  and  y  is  the  vector  of  measured  outputs  based  on  which  the  control 
action  is  generated.  A  standard  approach  is  to  treat  these  signals  in  some  normed  space.  If  the 
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related  signals  are  in  £2-space,  the  performance  of  a  system  is  measured  by  £2-gain,  or  Tfco- 
norm  for  a  linear  system.  The  7fM- control  problem  is  to  find  the  controller(s)  which  stabilizes 
the  closed  loop  system  and  minimizes  its  £2-gain.  The  general  linear  time  invariant  case  was 
first  solved  in  [9],  but  the  resulting  state-space  formulas  and  derivations  were  substantially 
streamlined  in  [11].  In  particular,  it  was  shown  that  the  control  problem,  which  requires 
the  Hoo -norm  of  the  closed  loop  system  less  than  1,  is  solvable  if  and  only  if  the  unique 
stabilizing  solutions  to  two  parallel  algebraic  Riccati  equations  are  positive  definite  and  the 
spectral  radius  of  their  product  is  less  than  1.  Furthermore,  controllers  which  solve  the  Wc 0 
problem  can  be  parameterized  as  a  linear  fractional  transformation  on  a  contractive,  stable 
free  parameter.  The  simplicity  of  this  characterization  together  with  its  clear  connections 
with  traditional  methods  in  optimal  control  have  stimulated  several  attempts  to  generalize 
the  7foo  results  in  state  space  to  nonlinear  systems.  (The  reader  is  referred  to  [2,  12,  13]  for 
the  generalization  in  the  context  of  operator  theory.)  We  will  abuse  terminology  and  use  the 
term  nonlinear  “Hoo  to  describe  such  efforts. 

The  study  of  dynamical  systems  which  have  finite  £2-gains  can  be  traced  back  to  at  least 
the  early  70’s.  It  is  known  that  the  finiteness  of  £2-gain  and  the  dissipativity  for  a  dynamical 
systems  are  strongly  connected.  A  systematic  exploration  of  general  dissipative  systems  was 
performed  by  Willems  [43];  some  extensions  can  be  found  in  [31,  20].  Recently,  in  the  context 
of  £2-gain  analysis,  van  der  Schaft  extensively  studied  the  £2-gain  of  nonlinear  time-invariant 
(NLTI)  control- affine  systems  by  using  dissipation  theory  [35,  36].  He  reconfirmed  that  the 
£2-gains  for  a  class  of  systems  can  be  characterized  by  Hamilton-Jacobi  equations  (HJEs)  or 
inequalities  (HJIs).  He  also  considered  the  solutions  of  HJEs  in  depth  in  terms  of  the  related 
Hamiltonian  vector  field.  Based  on  the  analysis  results,  he  investigated  the  'Hco  control 
problem  in  both  state  feedback  and  output  feedback  cases  for  a  class  of  NLTI  systems.  He 
showed  that  a  sufficient  condition  for  the  state  feedback  Hoo -control  problem  to  be  solvable  is 
that  the  corresponding  HJI  has  a  positive  solution.  In  the  output  feedback  case,  he  asserted 
that  the  7foo  control  problem  is  locally  solvable  if  it  is  solvable  for  the  linearized  system.  But 
this  assertion  requires  that  the  equilibrium  point  of  the  related  Hamiltonian  vector  field  be 
hyperbolic.  Isidori  and  Astolfi  [24,  25,  22]  developed  other  sufficient  conditions,  which  are  less 
conservative,  for  the  output  control  problem  to  be  solvable  from  a  game  theoretical  point  of 
view  (cf,  [6]).  They  showed  that  the  solution  to  the  control  problem  requires  the  existence 
of  positive  definite  solutions  of  two  hierarchically  coupled  HJIs.  They  also  parameterized  a 
class  of  controllers  for  the  full  information  (FI)  structure  [25]. 

Ball,  Helton  and  Walker  worked  on  the  nonlinear  control  problem  from  another  direc¬ 
tion  (see  [4,  5]).  They  derived  the  necessary  conditions  for  the  existence  of  an  output  feedback 
controller  such  that  the  HJI  related  to  the  closed  loop  system  has  a  positive  smooth  solution 
(specifically,  the  Tfoo-control  problem  is  solvable).  Just  as  neat  as  in  the  linear  case,  these  con¬ 
ditions  are  that  two  HJIs  have  positive  solutions  and  the  solutions  are  coupled  locally.  They 
confirmed  the  separation  principle  for  the  nonlinear  '/too -control  system,  and  also  provided  a 
recipe  to  construct  the  controllers  from  the  necessary  conditions,  although  the  stability  issue 
is  not  explicitly  considered  there.  It  is  noted  that  van  der  Schaft  [37]  and  Isidori  [23]  also 
considered  the  same  necessity  aspect  and  derived  the  similar  results. 
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Our  goal  in  this  paper  is  to  systematically  examine  the  nonlinear  W^-control  problem  in 
state  space  and  obtain  an  Woo  controller  parameterization.  We  use  the  state  space  approach 
to  deal  with  this  problem,  following  similar  techniques  used  in  the  linear  case  [11].  Both  G 
and  K  are  nonlinear  time-invariant  and  realized  as  affine  state-space  equations.  Four  special 
problems:  full  information  (FI),  disturbance  feedforward  (DF),  full  control  (FC)  and  output 
estimation  (OE),  are  also  considered.  The  sufficient  conditions  for  solvability  are  obtained 
and  a  parameterized  class  of  controllers  are  derived  for  each  Woo -control  problems  (note  that 
the  FI  problem  has  been  solved  by  van  der  Schaft  [36]  and  Isidori-Astolfi  [25],  see  also  Isidori 
[22]).  Sufficient  conditions  for  the  output  feedback  Woo-control  problem  to  be  solvable  locally 
are  also  derived  using  this  machinery.  Like  the  conditions  in  the  linear  case,  the  solvability 
of  the  Woo -control  problem  requires  the  positive  definite  solutions  to  two  parallel  decoupled 
HJIs  with  the  same  numbers  of  dependent  parameters  and  these  two  solutions  satisfy  an 
additional  condition.  It  can  be  shown  that  the  conditions  are  equivalent  to  the  ones  in  [22], 
which  simplified  the  main  result  in  [25].  A  class  of  Woo -controllers  are  parameterized  as  a 
nonlinear  fractional  transformation  on  contractive,  stable  free  nonlinear  operators.  In  each 
case,  the  stability  of  the  resulting  closed  loop  system  is  confirmed  via  the  use  of  its  hierarchical 
structure.  Any  concept  or  result  in  this  paper  is  local  unless  otherwise  noted.  Specifically, 
problems  DF,  OE  and  the  output  feedback  (OF)  are  treated  locally. 

This  paper  is  organized  as  follows:  In  section  2,  some  background  material  related  to  the 
£2-gains  is  given.  In  section  3,  the  Woo-control  problem  is  stated  and  the  structure  of  the 
general  system  is  simplified.  We  also  give  the  four  nonlinear  structures  of  special  problems 
related  to  the  general  system:  FI,  DF,  FC  and  OE.  In  section  4,  the  Woo-control  problem  for 
four  special  structures  are  considered,  both  the  solvability  conditions  and  controller  param¬ 
eterization  are  given.  In  section  5,  the  main  results  of  this  paper,  solutions  to  the  output 
feedback  Woo -control  problem,  are  given.  The  solvability  of  this  problem  requires  the  cou¬ 
pled  positive  definite  solutions  to  two  decoupled  HJIs.  The  standard  separation  principle  in 
this  case  is  re-examined  and  a  class  of  Woo-controllers  are  parameterized.  As  an  illustrative 
example,  the  Woo  control  design  for  a  passive  system  is  conducted. 


Conventions 

•  Abbreviations 

NLTI:  Nonlinear  Time-Invariant 
IDI:  Integral  Dissipation  Inequality 
DDI:  Differential  Dissipation  Inequality 
HJE:  Hamilton-Jacobi  Equation 
HJI:  Hamilton-Jacobi  Inequality 
FI:  Full  Information 
DF:  Disturbance  Feedforward 
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FC:  Full  Control 
OE:  Output  Estimation 
OF:  Output  Feedback 

•  Notations. 

R  is  the  set  of  real  numbers,  R+  :=  [0,  oo)  C  R. 

R"  is  n-dimensional  real  Euclidean  space;  if  u  G  Rn,  then  ||u||  is  Euclidean  norm  of  u. 

Rnxm  is  the  set  of  real  n  X  m  matrices;  if  A  G  R"xm,  then  AJ  G  Rmxn  is  the  transpose 
of  A. 


Br  :=  {x  G  Rn|  ||x||  <  r,for  some  integer  n  >  0} 

rT 

£2[0, T]  :=  { u  :  [0, T]^Rn\  /  ||u(0||2  dt  <  oo} 

Jo 

JpOO 

'  ||«(t)||2  dt  <  oo} 

o 

rT 

C\[ 0,oo)  :=  {u  :  [0,oo)->Rn|  /  ||u(t)||2^  <  oo,VT  G  R+} 

Jo 

df  d2f 

C2  :=  {/  :  Rn— >R|— (m),  — -(x)  exist  and  are  continuous} 

Interconnected  Nonliner  Systems 

The  following  two  notions  about  interconnected  nonlinear  systems  are  generalizations 
of  their  linear  counterparts  (see  [33]). 

-  Nonlinear  fractional  transformation:  Q,(G,K) 

w 


Jl 

G 

y 

K 

_J 

u 


Both  G  and  K  are  nonlinear.  If  this  feedback  system  is  well  posed,  then  the 
nonlinear  fractional  transformation  ft(<T,  K)  on  K  with  coefficient  G  is  defined  as 
the  nonlinear  operator  such  that 

z  =  f l(G,  K)w 


4 


for 


u  —  Ky 

Note  that  the  notion  of  nonlinear  fractional  transformation  was  also  introduced  by 
B all-Helton  [2]. 

—  Nonlinear  Redheffer  product:  E(Mj,M2) 


Both  Mi  and  M2  are  nonlinear.  If  the  interconnected  system  is  well  posed,  then 
the  nonlinear  Redheffer  product  £(Mi,M2)  of  and  M2  is  defined  to  be  the 
nonlinear  operator  such  that: 


Vi 

2/2 


with 


E(M1?M2) 


Ui 

u2 


2/i 

r 


v 

2/2 


2  Preliminaries:  C2- Gains  of  Nonlinear  Systems 

In  this  section,  some  background  material  about  £2-gain  analysis  of  nonlinear  systems  is 
provided.  The  reader  is  referred  to  Willems  [43],  van  der  Schaft  [36]  for  more  details. 

Consider  the  following  affine  nonlinear  time-invariant  (NLTI)  system: 

G  .  f  x  =  f(x)  +  g(x)u 
'  1  y  =  h(x )  +  k(x)u 

Where  x  G  Rn  is  state  vector,  u  £  and  ye  R3  are  input  and  output  vectors,  respectively. 
We  will  assume  f,g,h,k  e  C2,  and  /( 0)  =  0,h(0)  =  0.  Therefore,  0  E  K"  is  the  equilibrium 
of  the  system  with  u  —  0. 

The  nonlinear  operator  G  indicates  the  input-output  relation  of  the  above  system  with 
some  fixed  initial  condition,  i.e.  y  =  Gu.  The  state  transition  function  ^:R+xRnxRp->  E” 
is  so  defined  that  x  =  <f>(T,x0,  u *)  means  that  system  G  evolves  from  initial  state  x0  to  state 
x  in  time  T  under  the  control  action  u* . 
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Definition  2.1  (i)  A  system  G  (or  [f{x),g{x)])  is  reachable  from  0  if  for  all  x  £  R",  there 
exist  T  £  R+  and  u*(t )  £  £2[0,T]  such  that  x  = 

(ii)  A  system  G  (or[h(x),  f(x)])  is  (zero-state)  detectable  if  for  all  x  £  Rn,  h(cj)(t,x,  0))  = 
0  =>-  ^6(/,  a:,  0) — >0  as  t—>  oo;  it  is  (zero-state)  observable  if  for  all  x  £  1”,  h(<f)(t,x,  0))  = 
0  =>  <j)(t ,  x,  0)  =  0  for  all  t  £  R+. 

Definition  2.2  A  system  G  is  said  to  have  C2-gain  less  than  or  equal  to  1  if 

fT\m\\2dt<  f  urn2  dt 

Jo  Jo 

for  allT  >  0  and  u(t)  £  C2[ 0,  T],  and  y(t)  =  h(<f)(t,  0,  u(t ))  +  k(cf>(t,  0,  u{t))u{t). 

Note  that  in  the  above  definition,  we  take  the  initial  state  a;(0)  =  0.  Define 

OO 

(IKOII2  -  IIj/WII2)^- 

0 

Note  that  Va(x)  >  0  for  all  x  £  R”,  and  if  the  system  has  £2-gain  <  1,  then  Fa(0)  =  0.  We 
will  assume  (0)  =  0  from  now  on. 

As  pointed  out  by  Willems  [43],  Va(x )  <  oo  if  and  only  if  there  exists  a  solution  V  :  Rn— »R+ 
with  V(0)  =  0  to  the  integral  dissipation  inequality  (. ID1 ): 

vI(v,x,u):=v(x)-v(x0)-  f  (IKOII2  -  IbOOII2)^  <  o 

where  x  =  4 >(T,x0,u(t))  and  u{t)  £  £2[0,T],  i.e.  system  G  is  dissipative  with  respect  to 
supply  rate  ||u(f)||2  —  ||2/(f)||2,  and  Va(-)  is  also  a  solution.  Moreover,  the  solutions  to  IDI  form 
a  convex  set,  and  any  solution  V(x )  >  0  for  x  £  R”  with  F(0)  =  0  satisfies  V(x)  >  Va(x)  . 

Lemma  2.1  (Willems  [42,  43]) 

(i)  System  G  has  C^-gain  <  1  if  Va(x)  <  oo,  for  all  x  £  Rn. 

(ii)  If  system  G  is  reachable  from  0,  then  it  has  C^-gain  <  1  only  if  Va(x )  <  oo,  for  all 
x  £  R". 

Proof  (IF)  Va(x )  <  oo  satisfies  the  above  IDI,  so 

AiMOII2  -  IhXOII  V  >  va(x(T))  -  va(0)  =  va(x{r))  >  0 

Jo 

for  all  T  £  R+. 

(ONLY  IF)  Take  x  £  Rn,  by  the  reachability  assumption,  there  exist  T  £  R+  and 
Ui(t)  £  C2[—T,  0)  such  that  z(0)  =  x  for  x(—T)  =  0.  Now  take  any  u2{t)  £  £2[ 0,  oo).  Define 
u  £  C2[—T,  oo)  as 


u(t)  = 


«i(<),  if  t  £  [-T,  0) 
u2(t),  if  t  E  [0,  oo) 
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Since  system  has  £2-gain  <  1,  for  all  t  >  0 

~  Jo  (IM*)I|2  -  \\y(t)\\2)dt  <  J_T(Mt)\\2  -  \\y(t)\\2)dt 

SO 

/>oo  '  pO 

Va(x)  =  sup  -  (\\u(t)\\2-\\y(t)\\2)dt<  (||wi(0H2  -  \\y(t)\\2)dt  <  OO. 

«€^2[0,oo),a?(0)=a:  JQ  J —T 


□ 


Thus,  if  the  system  is  reachable  from  0,  then  £2-gain  <  1  if  and  only  if  the  system  is 
dissipative  with  respect  to  supply  rate  ||u(t)||2  -  ||y(t)||2;  also  Va(x)  >  0  is  well-defined  for 
all  x  E  Rn,  and  there  exists  a  solution  V{x )  >  0  to  the  above  IDI.  The  following  lemma 
characterizes  a  class  of  nonlinear  systems  having  £2-gain  <  1. 

Lemma  2.2  Consider  a  system  G  with  R(x )  :=  I  —  kT(x)k( x)  >  0  for  all  x  E  Rn,  suppose 
G  has  C2-gain  <  1. 

i)  IfVa(x)  is  differentiable  with  respect  to  x  E  Rn,  then  it  solves  the  following  Hamilton- 
Jacobi  equation  (HJE): 

W>*)  :=  ^(x)(f(x)  -  g(x)R~1(x)kT (x)h(x))  +  ^^(x)g(x)R-\x)gT(x)^-(x)+ 

hT (x)(I  -  k(x)kT (x))~lh{x)  =  0,  F(0)  =  0; 

ii)  IfV(x)  is  differentiable  with  respect  to  x  E  En,  then  it  satisfies  the  following  Hamilton- 
Jacobi  inequality  (HJI): 

H(V,z)  =  ^(x)(f(x)  -  g(x)R~1(x)kT (x)h(x))  +  ^~(x)g(x)R~1(x)gT(x)^—(x)+ 

hT(x)(I  —  k(x)kT(x))~1h(x )  <  0,  F(0)  =  0. 


Proof  Part  (i)  follows  from  the  same  argument  used  in  [26,  1].  As  for  Part  (ii),  since  V(x ) 
is  differentiable,  the  IDI  reduces  to  the  following  differential  dissipation  inequality  ( DD1 '): 

ot  r 

VD(V,x,u):=  ~ (x)(f(x)  +  g{x)u)~  ||it(i)||2  +  ||^)l|2  =  V(x)  -  |Kf)||2  +  ||j/(*)l|2  <  0 

It  follows  that  VD(V,  x,  u)  <  0  for  all  u(-)  E  £2[0,  oo)  if  and  only  if 
sup  VD(V,x,u)  <  0 

u(-)e^[°,oo) 

Let 

dVD(V,x,u)t 

r\  \U—U*  —  U 
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then 


u*  =  -R  1(x)kT(x)hT(x)  -  1(x)gT(x)^--(x) 

Thus, 


VD{V,x,u*)=  sup  VD(V,x,u)  <  0  •$=>  7T(V,x)<0. 

u6£|[0,oo) 


□ 


It  is  easy  to  see  that  the  converse  results  in  the  above  lemma  are  also  true  ([26,  1]).  The 
following  statement  follows  from  the  above  proof. 

Corollary  2.3  Suppose  7r(x)  is  a  function  defined  on  R”  with  7r(0)  =  0,  then  V(x)  with 
F(0)  =  0  solves  HJI:  H(V,x)  +  tt(x)  <  0  if  and  only  if  it  satisfies  DD I:  T>D(V,x,u)  +  w(x)  <  0, 
or 

j^(x)(f(x)  +  g(x)u)  <  |K*)||2  -  ||2/(t)||2  -  *■(*),  V(Q)  =  0 

for  all  u(-)  E  /^[O;00)-  Moreover,  ifir(x)  >  0  and  V(x)  >  0  for  all  x  E  R”,  then  the  C2-gain 

<  1- 


Corollary  2.4  The  solutions  to  TUT.  7i(V,x)  <  0  form  a  convex  set;  and  the  subset  of  non¬ 
negative  solutions  is  also  convex.  More  generally,  the  solutions  to  the  following  HJI: 

dV  1  dV  dV1 

^ 1 W'W + i  te  (x)E(x)-^(l) + 5(x)  s  0 

with  matrix  R(x)  =  RT { x)  >  0  and  g(0)  =  0  form  a  convex  set. 

The  above  discussion  can  be  summarized  as  following  Theorem. 


Theorem  2.5  (van  der  Schaft  [36])  Consider  system  G,  suppose  it  is  reachable  from  0,  then 
each  of  the  following  implications  holds  under  the  specified  condition. 

C2 -Gain  <  1 

Va  E  C2 

VI(V,x,u)<0  H(Va,x)  =  0 


V  EC2 


V  =  va 


T>d(V,  x,  u)  <  0 


n 


V,  x)  <  0 
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Recall  that  V  :  Rn— »-M+  is  locally  positive-definite  if  there  exists  r  >  0  such  that  for  x  £  Br, 
V(x)  =  0=>a:  =  0;  it  is  globally  positive-definite  if  F(a?)  =  0=>a;  =  0,  and  lim^oo  V{x)  =  oo. 
The  following  lemma,  which  is  due  to  Hill  and  Moylan  [20]  (see  also  [36]),  establishes  the 
relationship  between  finite  gain  (stability)  and  asymptotic  stability. 

Lemma  2.6  (i)  Suppose  system  G  with  u  =  0  is  asymptotically  stable  at  0,  then  any  V(x) 
with  V(0)  =  0  satisfying  IDI:  VfiV,  x,  u)  <  0  is  non-negative.  Specially,  ifV(x)  satisfies  HJI: 
H(V,x)  <  0  with  y(0)  =  0,  then  V(x)  >  0. 

(ii)  Assume  system  G  is  zero-state  detectable.  If  there  is  a  positive  definite  solution  V (x) 
to  HJI:  HIV,  x )  <  0,  then  the  system  G  with  u  =  0  is  asymptotically  stable  at  0. 

Definition  2.3  The  class  HQ  of  (affine)  NLTI  systems  is  defined  as 

HQ  :=  {G\G  is  asymptotically  stable  and  related  HJI  has  a  positive  definite  solution }. 

Therefore,  if  G  £  HQ  with  state  x,  then  there  exists  a  positive  definite  V{x)  such  that 
V(x)  <  ||u||2  —  ||j/||2  (here  y  —  Gu ),  so  it  has  £2-gain  <  1.  Moreover,  it  can  be  justified  that 
for  all  Q  G  HQ  Q  can  be  assumed  to  have  the  following  state  space  realization, 

{x  =  a(x)  +  b(x)u 
V  =  c(x ) 

In  fact,  consider  the  system  G ,  construct  system  Gn- 

(  x  =  fN(x)  +  gN(x)u 
\  Vn  =  hN(x) 


with 

fN(x)  =  f(x)  -  g(x)(I-  kT (x)k(x))~1kT (x)h(x), 
9n{x )  =  g(x)(I-  kT(x)k(x))~1/2 


and 


hii{x)  =  (I  —  k{x)kT  (x))  1!2h(x). 

System  G  can  be  simplified  as  Gn  in  the  following  sense. 

Theorem  2.7  Gn  is  of  gain  <  1,  and  the  related  HJE  (or  HJI)  has  solution  Va  >  0  (or 
V  >  0)  if  and  only  if  G  has  C2-gain  <  1,  and  its  corresponding  HJE  (or  HJI)  also  has  the 
same  solution.  Moreover,  Gn  is  zero-state  detectable  if  and  only  if  G  is. 


9 


Proof  Simple  algebra  shows  both  systems  correspond  to  the  same  HJE(or  HJI).  We  only 
need  to  show  that  system  Gn  is  zero-state  detectable  if  and  only  if  G  is. 

Notice  that 

h^{x)  =  (/  —  k(x)kT(x))~1^2h(x)  =  0  h(x)  =  0 

so  in  this  case 

/jv(»)  =  f(x)  -  g(x)R~1(x)kT  (x)h(x)  =  f(x) 

f  *  =  In(x)  (  x  =  /(*) 

\  Vn  =  hN(x)  =  0  \  y  =  h(x)  =  0 

so  Gn  is  detectable  if  and  only  if  G  is.  □ 


3  Tfoo-Control:  Problem  Statement  and  Simplifications 

3.1  7-fco-Control  Problem 

The  basic  block  diagram  considered  in  the  Woo- control  synthesis  problem  is 


G 

y 

■  K 

_J 

where  G  is  the  nonlinear  plant  with  two  sets  of  inputs:  the  exogenous  disturbance  inputs  w 
and  the  control  inputs  u,  and  two  sets  of  outputs:  the  measured  outputs  y  and  the  regulated 
outputs  z.  And  K  is  the  controller  to  be  designed.  Both  G  and  K  are  nonlinear  time-invariant 
and  can  be  realized  as  affine  state-space  equations: 


f  * 

=  /O) 

+ 

9i(x)w 

+ 

g2(x)u 

G  :  < 

- 

=  K{x) 

+ 

kn(x)w 

+ 

k12(x)u 

1  y 

=  h2  (x) 

+ 

k2i(x)w 

+ 

k22(x)u 

where  f,gi,hi,kij  6  C2  and  /( 0)  =  0,  /z1(0)  =  0,  h2(0)  =  0;  x,  w,  u,  z,  and  y  are  assumed  to 
have  dimensions  n,  p2,  q%,  and  q2,  respectively. 

K  .  f  x  =  a(x)  +  b(x)y 
'  (  «  =  c(x)  +  d(x)y 

with  a(0)  =  0,c(0)  =  0. 

The  initial  states  for  both  plant  and  controller  are  a;(0)  =  0  and  £(0)  =  0.  The  closed 
loop  system  will  be  denoted  as  nonlinear  operator  O (G,  K)  which  represents  the  input /output 
relation:  z  =  I()w. 
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TYoo-Control  Problem:  Find  a  feedback  controller  K  (or  a  class  controllers)  if  any,  such 
that  the  closed-loop  system  fl(G,  K )  is  asymptotically  stable  with  w  =  0  and  has  £2-gain 
<  1, i.e. 

f\\\w(t)\\2  -  \\z(t)\\2)dt  >  0; 

Jo 

for  all  T  £  K+. 

The  following  assumptions  on  system  structure  are  made: 

[Ala]:  k11(x)ki1(x)  <  I  for  all  x  €  Rn. 

[A2a]  :  rank(^i2(a:))  =  p2  for  all  x  €  R”. 

[A3a]:  rank(&2i(a;))  =  q2  for  all  x  G  Rn. 

3.2  System  Simplification 

Suppose  the  Tioo -control  problem  for  G  is  solvable,  and  the  corresponding  feedback  system  is 
well-posed.  The  following  result  structurally  simplifies  the  original  system. 

Theorem  3.1  Consider  system  G  under  the  above  assumptions,  then  it  can  be  converted  to 
a  system  with  following  structure 

x  =  f(x)  +  gi{x)w  +  g2(x)u 

■  z  =  hx(x)  +  k12(x)u 

y  =  h2{x)  +  k2i(x)w 

Where 

[Al]:  ku(x)  =  0,k22(x)  =  0; 

[A2] :  kj2(x)  [  hx(x)  k12(x)  ]  =  [  0  I  ]; 

[A31:  [£w]«(x)-[?]'- 

Proof  The  ideas  are  similar  to  the  ones  in  the  linear  system  simplification  (Safonov  et  al 
[34]),  the  involved  process  is  omitted  here.  □ 

From  now  on,  the  system  to  be  considered  has  this  simplified  structure. 

3.3  Special  Problems 

As  in  the  linear  case  [11],  we  will  consider  four  special  problems  which  will  help  us  to  examine 
the  insights  of  the  constructions  and  structures  of  nonlinear  TL^- controllers,  especially  to 
reveal  the  separation  property  for  nonlinear  Tfco -control  systems.  Practically,  as  to  be  shown 
by  some  examples,  they  are  also  very  important  in  their  own  right. 
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•  Full  Information  (FI)  Problem. 

In  this  case,  both  state  x  and  disturbance  w  are  directly  available  to  controller,  the 
plant  is 


X  ~  j 

f(x) 

+ 

9i(x)w 

Z  =  } 

1  + 

Gfi  '•  < 

'  a;  1 

’  o 

y  = 

.°  J 

+ 

I 

w 

with 

[A2]:  k{2(x)  hi(x) 

II 

s 

<M 

>45 

0 

I 

g2(x)u 

k12(x)u 


•  Full  Control  (FC)  Problem 


The  control  action  has  full  access  to  both  state  x  through  output  injection  and  the 
regulated  output. 


X  =  f(x) 

+  gi(x)w  + 

10 

Gfc  ■  < 

z  =  hx(x) 

.  y  =  h2(x) 

+ 

+  k2i(x)w 

'  0  I  ' 

with 

[A3]: 


9i(x) 

kai(x) 


*ai(®)  = 


0 

I  ; 


•  Disturbance  Feedforward  (DF)  Problem 


Gdf  ■  \ 


x 

z 

y 


f(x)  +  9i{x)w  +  g2(x)u 
h(x)  +  k12(x)u 

h0(x)  +  w 


where 

[A2]:  kj2(x)  |  hi(x)  k12(x)  J  =  0  /  J,  and 

[A6a]:  h0(x )  is  such  that  h0( 0)  =  0  and  x  =  f(x)  +  gi(x)h0(x)  is  asymptotically  stable 
at  0. 

•  Output  Estimation  (OE)  Problem 


Gqe 


x  =  f(x)  +  gi(x)w  +  g0{x)u 

z  =  hi(x)  +  u 

y  -  h2(x)  +  k2i(x)w 
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The  structural  assumptions  for  this  structure  are 

[A3]:  kt(x)  =  I  5 

[A7]:  g0(x )  is  such  that  x  =  f(x)  +  g0(x)h ^a;)  is  asymptotically  stable  at  0. 


4  T^oo-Control  Synthesis:  Solutions  to  Special  Problems 

Unlike  linear  case,  the  solutions  for  the  special  -control  problems  cannot  be  obtained  by 
duality  (if  there  is  any).  This  section  is  devoted  to  the  discussion  of  different  special  problems. 


4.1  Full  Information  Problem 


Consider 

x 

z 

Gfi  '■  ' 

y 

k 


f(x)  +  9i(x)w  +  g2{x)u 
hi(x)  +  kx2(x)u 


The  assumptions  relevant  to  FI  problem  are  inherited  from  OF  problem  as  follows. 

[A2]:  kf2(x)  [  hi(x)  k12(x )  ]  =  [  0  I  ]; 

[A4]:  [hi(x),  f(x)]  is  zero-state  detectable. 

The  H oo-control  problem  for  FI  was  first  explicitly  introduced  and  solved  by  Van  der  Schaft 
[35,  36]  (see  also  [22]).  The  solutions  to  Tfoo-control  problem  are  related  to  the  following  HJI: 

Hfz(V,x )  :=  ^(x)f(x)  +  ^^(x)(gi(x)gl(x)  -  g2(x)gl(x))^£-(x)  +  h^^h^x)  <  0, 

Note  that  the  set  of  solutions  to  this  HJI  is  not  convex  in  general  (Corollary  2.4).  The 
following  Theorem  reveals  more  properties  related  to  HJI  for  FI. 

Theorem  4.1  (i)  K.Fi(V,x)  <  0  has  a  solution  V(x)  with  V(0)  =  0  if  and  only  if  there  is 
F0(x )  such  that 

TisF(V,  F0,  x)  :=  ^(x)(f(x)  +  g2(x)F0(x))  +  \f^(x)gi  (x)gf(x)^(x)+ 

+(hi(x)  +  ki2(x)F0(x))T (hi(x)  +  k12(x)F0(x))  <  0. 

Moreover,  ifV(x)  solves  Hfi(V,x )  <  0  with  V(0)  =  0,  then  F0(x)  can  be  taken  as 
1  BVT 

Fo(x)  =  -±gT(x)™-(x). 

(ii)  If  [h±(x),  f(x)]  is  assumed  to  be  zero-state  observable,  then  any  solution  V (x)  >  0  to 
Hfi(V,x)  <  0  with  V (0)  =  0  is  positive  definite. 
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Property  (ii)  insures  that  the  HJI  corresponding  to  FI  has  a  positive  definite  solution 
under  some  mild  assumption  (observability).  This  justifies  the  assumption  that  HJI  has 
positive  definite  solutions  in  the  next  Theorem. 

Proof  (i)  Note  that  there  exists  F(x)  such  that 
nSF(V,FQ,x)<0 
if  and  only  if 

°  -  =  Wsf(F’  Fo>  *)U(.)=-4tf(«)*£:(*)  =  nFi{V,x) 

The  latter  can  be  confirmed  by  taking 

W(yAl)  =  0 

for  fixed  x. 

(ii)  Suppose  V{x)  >  0  is  such  that  Hfi(V,x)  <  0.  Then 
dV 

V(x)  =  ~(x)(f(x)  +  gi(x)w  +  g2(x)u ) 


1  dV  qv 

<  ~(jJ^(x)(9i(x)gT(x)  -  g2{x)gl{x))-^(x)  +  h\ {x)hx{x))  +  —(x)(gi(x)w  +  g2{x)u) 


4  dx 

1  J,  ,dVT .  , 
u  +  2s^x)-57(x> 


1  T,  JVT. 

w~2a ■  {x)~dF' {x) 


dx 


\z\?  +  INI2 


If  «=  then 

v(x)  <  -  INI2  +  HI2 

Since  V^a;)  >  0,  the  closed-loop  system 

(  X  =  f(x)  -  \g2{x)gl (x)^(x)  +  gi(x)w 
1  2  =  hi(x)  -  \ku(x)gl (x)2FL(x) 

is  dissipative  with  respect  to  supply  rate  ||u;||2  -  |N|2.  Thus,  for  all  x  £  R", 

JpOO 

(INO)II2  -  IN(0ll  2)dt 

0 


poo  poo 

>  -  /  (0  -  \\z{t)\\2)dt  =  /  (||*(<)||2)<fe 
Jo  Jo 
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V(x)  =  0  =►  ll^ll2  =  ||/iiO)||2  +  5 


9TAx)^(x) 


0,  so 


(  x  =  f(x)  -  \g2{x)gf{x)^{x)  (  x  =  f(x) 

\  z  =  hfix)  -  \k12(x)gf(x)^~{x)  =  0  \  hfix)  =  0 


So  x  =  0  by  observability  assumption.  (Moreover,  the  closed-loop  system  is  also  observable.) 
V{x)  is  (locally)  positive  definite.  □ 


The  solutions  to  the  -control  problem  for  FI  in  the  above  setting  are  restated  as 
following  two  Theorems  for  completeness  (see  also  [35,  36,  22,  25]). 

Theorem  4.2  ([35,  36,  22])  Consider  Gfi,  suppose  there  exists  V (x)  >  0  positive  definite 
such  that  ?iFj(V,x)  <  0,  with  U(0)  =  0.  Then  the  TL^-control  problem  for  FI  is  solvable. 
Moreover,  the  state  feedback 

1  T  (  »'/T 

“=-25aW-8T(l) 

solves  FI  H oo  -control  problem. 


Proof  (i)  £2-gain  <  1.  Use  the  same  argument  as  above,  if  u  =  -^gf(x)^-(x)  then 


V(x)  < 


+  inr 


It  follows  that 

AlMf  -  \\42)dt  >  V(x(T))  -  V(0)  =  V(x(T))  >  0. 

J  o 

for  all  T  >  0. 

(ii)  x  =  f(x)  -  ^g2(x)g2  (x)^jf(x)  is  asymptotically  stable. 
In  fact,  if  u  —  —^gf(x)^-(x),  then  the  closed-loop  system  is 

f  x  =  f(x)~  ±gfix)gf(x)?%f(x)+g1(x)w 
1  z  =  h1(x)  -  \k12(x)gf{x)^-{x) 


V(x)  is  positive  definite;  it  can  be  used  as  Lyapunov  function. 
Set  w  =  0, 


V(x)  <  |M|2  -  ||z||2 


=  -  z 


<  0. 


So  V(x)  =  0  =»  z  —  0  =>  x- 

system.  LaSalle’s  Theorem  implies  x  = 


oo  by  the  detectability  of  the  closed  loop 
(x)  is  asymptotically  stable. 

□ 


->0  as  t- 
f(x)  -  \g2{x)gf{x)^ 


The  following  result  parameterizes  a  class  of  FI  Woo -controllers. 
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Theorem  4.3  (Isidori-Astolfi  [25])  Under  the  assumptions  of  Theorem  4.2,  for  all  Q  £  TQ, 
the  controller 

1  T f  ^VT  ,  s  ,  1  T,  ^ VT  ,  ^ 

u  =  ~292  ^~dsT^  +  ~  291 

solves  the  Hco  control  problem  for  FI. 

Remark  4.1  If  V(x )  is  globally  positive  definite,  and  Hpi(V,x)  <  0  for  all  x  £  M",  then 
Theorem  4.1  gives  the  global  solution.  Moreover,  if  Q  £  TQ  globally,  then  Theorem  4.3 
also  gives  the  global  solutions.  The  same  thing  happens  for  FC  Tt'oo- control  problem  to  be 
investigated  later. 


4.2  Disturbance  Feedforward  Problem 


Consider 


x 

z 


=  /  0)  +  9i(x)w  +  g2(x)u 

=  hi(x)  +  k12(x)u 

=  h0(x)  +  w 


The  assumptions  relevant  to  DF  problem  are  as  follows: 

[A2] :  kf2(x)  hx(x)  k12(x)  =  0  J  ]; 

[A4]:  [hi(x),  f(x)]  is  (locally)  zero-state  detectable. 

[A6a]:  x  =  f(x)  -f  gi(x)h0(x)  is  (locally)  asymptotically  stable  at  0. 

By  converse  Lyapunov  Theorem(cf.  [18,  39]),  assumption  [A6a]  implies  that  there  exists 
a  locally  positive  definite  function  U  :  Rn— >R+,  such  that 

Ld(U,x )  :=  jj^(x)(f(x)  +  gi(x)ho(x)) 


is  negative  definite.  Furthermore,  assume 

[A6]:  x  —  /(x)  +  gi(x)h0(x)  is  (locally)  exponentially  stable  at  0. 

Note  that  under  the  assumption  [A6],  the  Hessian  matrix  of  LD(U,x)  is  nonsingular  at 
x  =  0  by  suitably  choosing  the  Lyapunov  function  U(x).  And  if  U(x)  has  these  properties, 
so  does  kU(x)  for  all  constant  k  >  0. 


Theorem  4.4  Consider  Gdf,  suppose  there  exists  a  smooth  solution  F(0)  >  0  to  x)  < 

0  with  V(0)  =  0.  Then  the  Hco -control  for  DF  problem  is  (locally)  solvable.  Moreover,  when 
the  state  of  the  closed  loop  system  stays  in  Br  for  some  r  >  0,  the  controller  given  by 

f  x  =  f(x)  -  gi(x)h0(x)  +  g0(x)F0(x)  +  Sl(x)y  —  1nT(z\dVT(t\ 

\u  =  F0(x)  *o{x)-  2J3W¥(*j 

solves  the  -control  problem. 


16 


Consider  the  system 


f  x  -  f(x)  -  gi(x)h0(x)  +  gi(x)y  +  g2(x)u 
u  =  u 


DF 


Vo 


x 

- h0(x ) 


+ 


0 

I 


y 


We  have  the  following  lemma. 


Lemma  4.5  For  any  T(x)  >  0  satisfies  above  HJI,  let  x,x  be  states  of  systems  GDF  and 
Pdf,  let  e  =  x  —  x.  Define 

S(U,  e ,  x)  :=  ^(e)[(/(a-)  -  f(x))  -  gx(x)(h0(x)  -  h0(x))]; 

T(U,e,x)  :=  S(e,x)~  ~^-{e){g2(x)  -  g2{x))gl{x)^-{xfi 
Ri(e,x)  :=  ti{(x)hi(x)  —  hf(x)hi{x)\ 


R2(e,x) 


1 


ldV,„.  T.  .  T,~^dUT ,  . 

+  ^^gfixMix)  -  gx  (x))—(e)+ 


-\^r{x)92(x){gl(x)  -  gj (5))^~(e)- 

Then  there  exists  U(x)  such  that  for  all  ( x,x )  6  Br  with  some  r  >  0, 

(i)  S{U,  e,  x)  <  0, 

(it)  S(U,  e,  x)  +  f?i(e,  x )  +  R2(e,  x)  <  0, 

(Hi)  T(U,e,x )  is  negative  definite. 

Proof  Just  note  that  S{U,e,  x)  has  the  same  Hessian  matrix  with  respect  to  e  at  (e,  x)  =  0 
as  Ld(U ,  e)  does.  Also  if  U (x)  is  such  that  LD(U,  e )  has  negative  definite  Hessian  matrix  with 
respect  to  e  at  0,  so  is  kU(x)  for  all  constant  k  >  0.  □ 


Proof  of  Theorem  4.4 

Consider  S {Gdf,  Pdf),  which  has  following  realization 

f  x  =  f(x)  +  gi(x)w  +  g2{x)u 

X  =  (f(x)  -  gfix)ho(x)  +  gi(x)h0(x))  +  gi(x)w  +  g2(x)u 

z  —  hx(x)  +  k12(x)u 


h0(x )  -  h0(x) 


+ 


0 

I 


w 
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Let  e  x  —  x,  define 
W(e,x)  :=  U(e)  +  V(x) 

where  U(x )  is  given  in  the  above  lemma,  then  W(e,x)  >  0,  and  LF(0,0)  =  17(0)  +  F(0)  =  0. 
For  all  ( x ,  it)  G  Br. 


W(e,x)  =  U(e)  +  V(x) 
dU 


=  “  /(*))  “  9i(x)(h0(x)  -  h0(z)))+ 

dU 

+-fc(e)((9i(x)  ~  9i(x))w  +  (g2(x)  -  g2(x))u)+ 

dV  dV 

+  gi{x)w  +  g2{x)u)  +  -^(x)gi(x)(h0(x)  -  h0 

<  S(U,e , x)  +  -  gi{x))w  +  ^(e)(g2(x)  -  g2(x))u+ 

-\^(e){9i(x)gl{x)  -  g2(x)gl(x))^-{e)  -  h*(x)h1(x)+ 

dV  dV 

+-QZ-(x)(g1(x)iv  +  g2(x)u)  +  —  (x )g1(x)(h0(x)  -  h0(x)) 

=  S(U,  e,  x)  +  Ri(e,  x )  +  R2(e,  x) 


+ 


,  1  T,„,dVT,^  l f  T r  \  T,~,\dUT,  , 

u  +  2^2  (*)-0|-(*)  +  2^2  (*)  -  9i(x))-fc-(e) 


(9^{x)-gx{x))^-(e) 


+ 


1  t,~^Vt  1/  T/  N  Tl.^dUT ,  s 

W  ~  29x  ~  2^9x  ^  ~  9l  ^~dT^ 


Ml 2  +  INI2 


< 


,  1  T,~,dVT,^  ,  1,  T/  ,  T,~„dUT/  N 

U  +  292  +  2  ^  (a;)  “  9 2  (*))“^-(«) 


+ 


1  Tr~\^^T  f~\  1/  T/  \  T/~\\dUT  .  \ 

w  -  o ~  o(0i  (*)  -  0i  (a;))-^r(e) 


(?e 


-  INI2  +  INI2 


If  we  take 

«  =  =  -W), 
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then 


W(e,  x)  <  —  \\z\\2  +  ||tw 


so 

/ T(IMI 2  -  Ikll2)*  >  W(e(T),  x(T))  -  W( 0, 0)  =  W(e(T),  x(T))  >  0. 

Jo 

for  all  T  >  0  and  ( x ,  x)  £  Br. 

Next,  consider  the  asymptotic  stability  of  the  closed-loop  system.  It  is  sufficient  to  show 
if  (x(0),x(0))  £  Br ,  then  (x(t),x(t))-+  0  or  (e({),x({))— >-0  as  t—> oo.  Take 

1  T,~^VT 

u  =  _2 5,2  and  W  =  0> 

F(x)  and  17(e)  is  positive  definite  by  assumptions.  Therefore  W(e,x)  =  {7(e)  +  F(x)  is 
also  positive  definite,  and  it  can  be  used  as  a  Lyapunov  function. 

We  already  have 

W(e,x)  <  -  II^H2  +  ||w||2  =  -  ||^r||2  <  0 

Now  W(e,x)  —  0  =>•  £  =  0  =*•  x(t)—> 0  as  t— >oo  by  assumption  [A4].  On  the  other 

hand,  {7(e)  =  T(U,e,x)  is  negative  definite  for  (x,x)  £  Br  by  previous  lemma,  then  e(f)— >0 
as  t—> 00.  By  LaSalle’s  Theorem,  the  closed  loop  system  is  (locally)  asymptotically  stable. 

Finally,  the  DF  controller  u  =  Q(PVF,  KFI)y  is  recovered  as 

f  *  =  /(*)  -  \9i{x)g^{x)^-(x)  -  gi(x)h0(x)  -  9l{x)y 
1 « = 


□ 


Next,  we  consider  the  controller  parameterization.  Denote 

eu(x,x)  :=  ^(gj(x)  -  g^(x))~~(e),  ew(x,x)  :=  ^(g{(x)  -  gf(x))~^-(e) 
Define 

*  1  ...  . 
u  ■= -^9i(x)-^(x)-eu(x,x) 

*  1 

w  29i{x)-jr-{x)  +  eu{x,x) 

From  the  previous  proof, 

W(e,x)  <  ||tt  -  u*||2  -  ||w  -  w*\\2  -  ||z||2  +  |M|2 
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If  take 


u  =  u*  +  Q(w  —  w *) 

with  Q  G  FQ,  let  £  be  the  state  variable  for  Q.  And  Uq  is  a  solution  to  the  HJI  with  respect 
to  Q,  then 

Uq(0  <  Ik  -  w*||2  -  llw  —  u* I]2 

then 

W(e,x)  +  Uq(£)  <  —  k||2  +  |k||2 
so 

/T(lkl|2  -  Ikll2)*  >  W(e(T),  x(T))  +  UgtfiT))  >  0. 

It  seems  that  the  controller  recovered  from  u  =  u*  +  Q(w  —  w*)  solves  the  7^ -control  problem 
for  DF.  However,  it  can  hardly  be  physically  implemented,  since  (i)  Q  requires  some  extra  high 
order  terms  eu(x,  x )  and  ew(x,  x )  as  parts  of  its  input  and  output,  but  they  can  not  be  provided 
by  the  closed  loop  system;  and  (ii)  the  term  h0(x)  -  h0{x),  which  is  a  part  of  the  measured 
output,  does  not  appear  in  the  required  input  for  Q.  But,  fortunately,  the  terms  eu(x,x) 
and  ew(x,x)  can  be  eliminated  by  the  assumption  [A6];  and  h0(x)  -  h0(x)  is  actually  the 
measured  noise  introduced  by  the  controller.  It  is  reasonable  to  take  wdf  —  w  +  h0(x)  —  hQ(x) 
as  the  total  disturbance. 

The  DF  Tfcc-control  problem  can  be  modified  as  follows. 

7foo-Control  Problem  for  DF:  Find  a  class  of  controllers  such  that  the  closed  loop 
system  satisfies 

/  (INI2  -  \\wDF\\2)dt  <  0. 

Jo 

for  all  T  >  0,  i.e.,  the  controllers  attenuate  the  external  disturbance  and  the  measured  noise 
introduced  by  itself.  It  can  be  concluded  that 

Theorem  4.6  Under  the  assumptions  of  previous  Theorem,  define 

Fo(x)  ■=  ~^gl  O)-^r(z),  *H®)  •- 

The  controller  u  =  Q(MfdiQ)v  with  Mdf  given  by 

x  =  f(x)  +  g2(x)F0(x)  -  g1{x)h0(x)  +  9i{x)y  +  g2{x)u0 

<  u  =  F0(x))  u0 

y0  =  -ho(x)-Fi(x)  +  y 

for  all  Q  G  TG  also  (locally)  solves  DF  Hco-control  problem. 


20 


Proof  Consider  system  £1(Gdf,&(Mdf,Q)),  assume  £  is  the  state  of  Q.  Take  W(e,x)  the 
same  as  in  previous  them,  the  same  arguments  in  previous  proof  yield  that,  for  all  (x,x,£)  £ 

Br. 

W{e,x)<  u  +  ^gl{x)^^{x)  -  wDF  -  -  IMl"  +  \\wDf\? 

Since  Q  £  TG,  then  there  is  a  positive  definite  Uc(£)  related  to  Q  such  that 

1  ™  dVT  2  1  m  dVT 

Uc(0<~  u+-g2  (*)"^"(*)  +  Wdf~  29l^~dT^) 

So 

W(e,x)  +  Uc(0<-M2  +  \\wDF\\2 

It  can  be  concluded  that 

[T{\\wdf\\2  -  \\z\f)dt  >  0,VT  G  R+. 

Jo 

Next,  consider  the  stability  of  the  closed  loop  system  whose  state  is  (e,a;,£),  set  w  =  0, 
then  it  is  of  the  form 

e  =  a(t,  e ) 

'x  -  f3(t,e,x,£) 

£  =  <*(£)  + K  OVo 

where  y0|(e,*)=o  =  0.  Notice  that  the  subsystems  with  states  e,  x  and  £  are  hierarchically 
interconnected.  Assume  the  closed  loop  system  evolves  in  Br.  e—>0  as  t— s-oo  by  the  similar 
argument  in  the  proof  of  previous  Theorem.  Consider  the  connected  system  with  state  (*,£); 
Ldf{x,0  :=  W(e,x)\e=0+Uc(£)  is  positive  definite,  and  can  be  used  as  the  Lyapunov  function. 
Let  w  =  0.  Since  e  =  x  —  x  =  0,  wDF  =  0. 

ldf(x,o<-  NI2<o 

Ldf{x,0  =  0  implies  z  =  0,  so  x(t)  =  x(t)~* 0  as  t-+  oo.  On  the  other  hand,  x  —  0 
— »  Vo  —  0,  this  also  implies  £(<)— >0  as  t-+  oo.  LaSalle’s  Theorem  implies  interconnected 
system  with  states  (®,£)  is  asymptotically  stable.  By  the  stability  Theorem  of  hierarchical 
systems([38,  39]),  The  closed  loop  system  is  (locally)  asymptotically  stable.  □ 
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4.3  Full  Control  Problem 

Consider  the  system 


/ 

X 

=  /(*) 

+ 

gi(x)w  +  10 

Gpc  •  < 

z 

=  hi{x) 

+ 

0  I 

.  y 

-  h2(x) 

+ 

k21(x)w 

The  assumptions  for  this  structure  are 

fA3^:  M*)  i  ; 

[A5]:  [h2(a;),  f(x)]  is  zero-state  detectable.. 

The  solvability  of  Tfoo -control  problem  to  FC  is  also  related  to  the  HJI: 

nFC(U,x):=  ^{x)f{x)  +  2^{x)g1{x)gl{x)^-{x)  +  hl{x)h1{x)-hl{x)h2{x)  <  0, 

A  nice  property  for  this  HJI  is  that  its  solutions  form  a  convex  set  (Corollary  2.4). 
Theorem  4.7  (i)  IfU(x)  with  17(0)  =  0  satisfies 

nrr 

Hoi(U,  L0,  x)  :=  —  (z)(/(a:)  +  L0(x)h2(x))+ 

-\-^^{x){gi{x)  +  L0(x)k2i(x))(g1(x)  +  LQ(x)k21(x))T  ^—(x )  +  hf  (x)hx(x)  <  0 

for  some  L0(x),  then  U(x)  satisfies  Hfc(U,x )  <  0  with  U{ 0)  =  0  as  well. 

Conversely,  if  U(x)  satisfies  Hfc(U,x)  <  0  with  U(0 )  =  0,  and  L0(x)  is  such  that 

^(x)Lq(x)  =  —2  h%(x). 

Then  HOi(U,L0,x )  <  0. 

(ii)  If  system  [h2(x),  f(x)]  is  zero-state  observable.  Suppose  U(x)  >  0  solves  Tt fc ( 17,  x )  < 

0  with  Z7(0)  =  0.  If 

j^(x)L0(x)  =  -2  h£(x), 

has  a  solution  Lq(x),  then  U (x)  is  positive  definite. 
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Proof  (i)  Notice  that  there  exists  L0(x)  such  that 
Ttoi(U,Lo,x)  <  0 


only  if 

0  >  inf  HOi(U,L0,x)  =  HoiiU,  L0,  x)\w(x)Lo(x)=_2hT(x)  =  HFC(U,x) 

IKaOioO) 


And  it  is  also  sufficient  if  |j(*)Z0(«)  =  -2 h%(x)  has  a  solution  L0(x). 
(ii)  Will  be  proved  during  the  proof  of  the  following  Theorem. 


□ 


Theorem  4.8  Suppose  U{x)  positive  definite  is  such  that  'Hfc(U,x)  <  0.  If  L0(x)  satisfies 
F)TI 

—  (x)L0(x)  =  -2 -h%(x), 
then  the  controller  given  by  “output  injection” 


u 


(x)  = 


L0(x) 

0 


solves  the  -control  problem  for  FC. 


Proof  (i)  C2- gain  <  1.  Just  U(x)  >  0  is  assumed. 

U{x)  =  ^(x)(f(x)  + gfix)w+  [  I  0  ]  it) 

<  (x)9i(x)^z~(x)  -  hj(x)h x(x)  +  h%(x)h2(x)+ 


dU ,  .  ,  , 

+-fai(xmx)w  + 


dx 

dU 

dx 


(x)  0 


+( 


0  I  \  u 

r  eu_ 

dx 


dUT 

w  ~  9i  (x)~Qjr(x)  +  k2i(x)h2(x) 


NI2  +  IHI2  + 


(®)  2 h[(x) 


,  +  2h%(x)(h2(x)  +  k2x(x)w)) 


Note  that  k2X(x)k21{x)  =  I  for  aU  *  £  Kn  by  assumption  [A3],  so  ||A;2i(x)r||  <  ||w||  for  all 
v  £  RPl. 

Observe  that  y  =  h2(x)  +  k2 \{x)w  =  k2X(x)(w  -  gf(x)§^-(x)  +  x)h2(x)),  then 


\\yf  =  \\h2{x)  +  k21{x)w\\2  < 


dUT 

w-gx  +  kh(x)h^x) 


23 


So 

U(x)  < 
Note  that 


0  /]ti||  -  IM|2  -  IM|2  +  IMf  +  ([  fsf(*)  2h1{x)}u  +  2b%(x)y) 


u{*)  <  -  Nl2  -  Nl2  +  INI2  <  -  INI2  +  INI2 

if  u  is  such  that  J  0  I  J  u  =  0  and  ^  ^r(x)  2h'[(x)  j  u  +  2 h%(x)y  =  0,  but  it  is  guaranteed 
by  taking  the  controller  as  the  given  “output  injection”: 


u(x ) 


L0(x) 

0 


where  L0(x)  solves 

J~(x)L0(  x)  =  -2  h$(x). 

It  follows  that 

AlMf  -  \\4 2)dt  >  U(x(T))  -  U( 0)  =  U(x(T))  >  0 
J  o 

for  all  T  >  0. 

(ii)  Proof  of  Theorem  4.7(ii).  It  is  assumed  [h2(x),  f(x)\  is  observable  in  this  proof. 
If  the  above  controller  is  taken,  then  the  closed  loop  system  is 

x  =  f(x)  +  L0(x)h2(x)  +  (gi(x)  +  L0(x)k21(x))w 
<  2  =  hi(x) 

y  =  h2(x)  +  k21(x)w 

From  the  previous  proof, 

u(x)<  -  IMI2  -  INI2  +  IMI2 

Since  U(x)  >  0,  the  closed  loop  system  is  dissipative  with  respect  to  IK*)II  -  IK*)II2  - 
||y(f)||  .  For  all  x  6  Rn, 

pOO 

U(x)>  sup  -  (IK<)II2  -  lk(0ll2  -  llsWII2)* 

w6>C2[0,cx>),a?(0)=a?  J  0 


poo  poo 

>-/  (0-IK<)ll2-llyWII2)*=  /  (IKOII2  +  IkWII2)* 

JO  Jo 

U(x)  =  0  y(t)  =  h2(x(t))  =  0  for  w(t)  =  0. 

f  x  =  f(x)  +  L0(x)h2(x)  (  x  =  f(x) 

\  h2(x)  =  0  |  h2(x)  =  0 
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By  the  observability  assumption  x  =  0,  U{x )  is  (locally)  positive  definite. 


(iii)  Asymptotic  Stability 

U(x )  is  positive  definite  by  assumption,  it  can  be  used  as  a  Lyapunov  function. 
Set  w  =  0, 


U(x)  <  IKOII2  -  \W)\\2  ~  IMz(i))||2  =  -  \\z(t)\\2  -  ||h2(a:(t))||2  <  0. 


So  U(x )  =  0  =>  h2(x(t ))  =  0  =>  x(t)-^0  as  t-+  oo  by  assumption  [A5]. 
Theorem  implies  x  =  f(x)  +  L0(x)h2(x)  is  asymptotically  stable. 


LaSalle’s 

□ 


From  the  above  proof, 

U{x)  <  ||u2||2  -  \\y\\2  -  \\z\\2  +  ||u;j|2  +  (|^(*)«i  +  2hf(x)u2  +  2 hj(x)y) 

Assume  Lx(x)  is  such  that 
8 II 

^(x)Lx(x)  =  -2hTx(x), 

Take  ux  —  L0(x)y  +  Lx(x)u2,  then 

^(x)ui  +  2  hf(x)u2  +  2  h%(x)y  =  0 
Therefore 

U(x)  <  \\u2f  -  ||y||2  -  \\zf  +  |H|2 

Let  u2  =  Qy  with  Q  G  IFQ  (so  ux  =  L0(x)y  +  L2{x)Qy  then),  Q  can  be  assumed  to  have 
the  following  realization 

/  i  =  a(0  +  b(0y 

\  «2  =  C(0 

Then  there  exists  £/c(£)  >  0  positive  definite  such  that 

UO  <  llvll 2  -  INI2 

and  £  =  a(£)  is  asymptotically  stable. 

Define  W{x,£)  =  U(x)  +  [/„(£)  for  (x,£)  G  K"  X  I",  then  LF(x,£)  >  0  is  positive  definite. 
W(x,t)  =  U(x)  +  Ue  (0 

<  (llw2||2  -  ||j/||2  -  M2  +  ||w||2)  +  (||j/||2  -  ||u2|j2) 

=  IMI2-  INI2 


/  (Ihll2  -  Ikll2)*  >  W(x(T),t(T))  -  W(0, 0)  -  W{x{T),i{T))  >  0. 
Jo 

for  all  T  >  0. 

Thus,  we  motivated  the  characterization  of  a  class  of  controllers. 
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Theorem  4.9  The  assumptions  are  the  same  as  in  the  last  Theorem.  If  in  addition,  U  is 
such  that  TLfc{U,  x)  is  negative  definite,  and  Li(x)  also  satisfies: 

^(x)L1(x)  =  -2  h\{x), 

then 

u  =  L0(x)  +  L1(x)Q  y 

Q 

for  all  Q  E  FQ  also  solves  the  Ho^-control  problem  for  FC. 

Proof  We  only  need  to  consider  the  stability.  Since  Hfc(U,x)  is  negative  definite,  then 
there  exist  a  positive  definite  tt(x),  such  that 

Hfc{U,x)  +  7r (x)  <  0 

By  corollary  2.3, 

u(x)  <  IMI2  -  \\y\\2  -  INI2  +  |M|*  -  tc(x) 

W(a:,£)  =  U{x)  +  Uc(£)  is  positive  definite,  as  U(x)  and  Uc(0  are.  It  can  be  taken  as 
Lyapunov  function,  let  w  =  0,  then 

W(z,0  <  (||u2||2  -  ||t/||2  -  ||*|j2  -  Tt(x))  +  ||y||2  -  ||u2||2)  =  -  ||2||2  -  tt(x)  <  0 

Note  that  W{x,  £)  =  0  implies  7r(x)  =  0,  x  =  0  by  assumption.  If  x  =  0  then  £  = 
a(0  +  b(£)y  =  a(£)  is  asymptotically  stable,  so  £(f)  — >  0  as  t  — >  oo.  LaSalle’s  Theorem 
implies  the  asymptotic  stability.  □ 

4.4  Output  Estimation  Problem 

Consider 

{x  =  f(x)  +  gi(x)w  +  g0(x)u 

z  =  hi(a;)  +  u 

y  =  h2(x)  +  k21(x)w 

The  assumptions  for  this  structure  are 

[A3]:  kn(x)  k^X)  =  I  ; 

[A5]:  [h2(x),  f(x)]  is  (locally)  zero-state  detectable. 
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Theorem  4.10  Consider  Gob,  suppose  there  exists  a  positive  definite  solution  U(x')  to  HJI: 
Hfc(U,x)  <  0,  with  U  (0)  =  0;  and  U(x)  makes  the  Hessian  matrix  of  hi  pc  (  U,  x  )  with  respect 
to  x  £  K"  be  negative  definite  at  0.  If  L0(x)  satisfies 

^(x)Lq(x)  =  -2  h£(x), 

then  there  exists  a  controller  such  that  the  closed  loop  system  locally  has  C2-gain  <  1.  And 
such  a  controller  can  be  given  by 

TS  .  /  ®  =  /(*)  -  go(x)h1(x)  +  L0(x)h2(x)  -  Lo(x)y 
Ji-OE  •  i  i 

I  u  =  —h1{ x) 

Furthermore,  the  closed  loop  system  is  also  (locally)  asymptotically  stable  at  0,  if  in  addi¬ 
tion, 

[AT]:  x  =  f(x)  —  go(x)hi(x)  is  (locally)  asymptotically  stable, 

Remark  4.2  Another  controller  which  results  in  the  closed  loop  system  locally  having  C2- 
gain  <  1  is 

(  x  =  f(x)  -  goi^hfix)  +  L0(x)h2(x)  +  L0(x)y 

1  u  =  hi{x) 

But  the  asymptotic  stability  can  only  be  insured  by  that  x  =  f(x)—g0(x)hi(x)  is  exponentially 
stable. 

Lemma  4.11  Suppose  the  positive  definite  U(x )  >  0  is  such  that  Hfc(JJ,x )  is  negative 
definite.  Let  x,x  be  states  of  systems  Gqe  and  Kqe,  e  =  x  —  x.  Define 


He(e,x)  —(e)(f(x)  -  f(x)  +  L0(x)(h2(x)  -  h2(x)))+ 


+^^-(e)(flh(a;)  +  L0(x)k12(x))(gfix)  +  L0(x)k12(x))T^—(e)+ 


+(hi  (®)  ~  K  (x))(hi(x)  -  hfix))  -  —  (e)(g0(x)  -  g0(x))hx(x) 


with  L0(x)  defined  as  in  previous  Theorem.  Then  for  all  ( x,x )  6  Br  with  some  r  >  0, 
7ie(e,x)  <  0.  Moreover,  there  exists  ir(e)  (locally)  positive  definite  such  that  7ie(e,x)-\-i r(e)  < 
0. 
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Proof  Recall  that  7 ioi(U,  L0,  e )  =  'Hfc(U,  e),  where 

ATT 

nQi(U,  L0,  e )  :=  -^(e)(/(e)  +  Z0(e)h2(e))+ 

+^g^"(e)(5i(e)  +  ^0(e)A)2i(e))(51(e)  -f  L0(e)k2i(e))T-^-(e)  +  h1(e)hx(e) 

Also  note  that  the  Hessian  matrix  of  He(e,x)  with  respect  to  e  at  0  is  the  same  as  the  one  of 
7ioi(U,L0,e)  =  Hpc(U,e )  with  respect  to  e  at  0.  □ 


Remark  4.3  If  we  take  u  = 


hi(x)  + 


0  I 


u,  then 


L0(x ) 

0 


y  with  y0  =  h2{x)  -  h2(x)  -  k12(x)w ,  let  2  =  hx(x)  - 


U(e)  =  e){f{x )  -  f(x))  +  gx(x)w  +  [  I  0  ]  u) 

<  ~  IMI2  +  INH2  -  \\z\f  -  ^(e)OoO)  -  go{x))hx{x) 
for  all  (x,  x)  G  Br. 


Proof  of  Theoi'em  4.10  Consider  i}(GOE,  Kpc)  which  has  following  realization 

x  -  f{x)-gQ{x)h1(x)  +  gi(x)w 

<  X  =  (f(x)  -  goi^h^x))  +  LQ{x)(h2(x)  -  h2{x))  -  L0(x)k21(x)w 
z  —  hx(x)  —  hi{x) 

Let  e  =  x  —  x,  for  (x,  x)  G  Br. 

C\  T-T 

U(e )  =  -fo(e)(,(f(x)  -  f(x)  +  L0(x)(h2(x)  -  h2(x))+ 

dU 

~(L0(x)k21(x)  +  (<7i(a;))n;)  -  -^-(e)(g0(x)  -  go{x))hx(x) 

<  INI2  -  INI2  -  IMI2  <  -  Ml2  +  IMi2 


so 

AlMI2  -  Ikll2)*  >  U(e{T))  -  U{ 0)  =  U(e(T))  >  0. 
Jo 

for  all  T  >  0. 
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Next,  the  asymptotic  stability  of  the  closed  loop  system  is  considered.  It  has  the  realization 
as  follows. 

(  i  =  f(x)  -  5o(z)Mz)  +  L0(x)(h2(x)  -  h2(x)) 

\  e  =  V(t,e) 

Since  U(e)  is  positive  definite  from  the  negative  definiteness  of  (Hessian  matrix  of)  HFC(U,  e ). 
Therefore  e(t)  — *■  0  as  t  oo.  Note  also  that  x  =  f(x)  —  g0(x)hi(x)  is  asymptotically  sta¬ 
ble.  Since  the  two  systems  are  hierarchically  interconnected,  and  asymptotically  stable,  the 
interconnected  system  is  asymptotically  stable(cf.  [38]).  □ 


Theorem  4.12  Under  the  assumption  of  the  previous  Theorem,  if  in  addition,  Li(x)  is  such 
that 

BTT 

—Whix)  =  -2  hj(x), 

then  the  controller  u  =  Cl(M0E,Q)y  with  Moe  given  by 

x  =  f(x)  -  g0(x)hx(x)  +  LQ(x)h2(x)  -  L0(x)y  +  (g2(x)  +  Li(x))u2 

<  u  =  —hi(x)  +  u2 

2/o  =  h2(x)  -  y 

for  all  Q  G  TQ  also  (locally)  solves  ‘HCXi -control  problem  for  OE. 

Proof  Consider  Q,(G0E,tt(M0E,Q))  for  Q  G  TQ  which  has  following  realization. 

f  i  =  <*(£)  +  KOy 

\  «2  =  <0 

The  similar  argument  shows  that  there  exists  r  >  0,  for  (x,  x,f)  G  Br, 

U(e)  <  ||w||2  -  \\z\\2  -  ||2/o||2  +  IM|2  -  tt(c) 

for  some  locally  positive  definite  7r(e). 

And  Uq  is  a  solution  to  the  HJI  with  respect  to  Q  with  state  £,  then 

So 

W{e,x)  +  UQ( 0  <  -  \\z\\2  +  ||rr||2  -  7r(e)  <  -  |M|2  +  |M|2 
Therefore, 

AlNI2  -  Ikll2)*  <  W( 0, 0)  -  W(e(T),  x(T))  =  —W(e(T),  ~x(T))  <  0. 

Jo 
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As  for  the  stability,  take  w  —  0  then  the  closed  loop  system  has  following  hierarchical 
structure. 

g  zz  g) 

-  i  =  <*(£)  +  b(£)(h2(x)  -  h2(x)) 

.  x  =  f(x)  -  ff0(i)hi(5)  +  L0(x)(h2(x )  -  h2(x))  +  (g2(x)  +  L i(x))c(£) 

Take  Loe(c>0  —  W(e,x)  +  Uq(£)  as  the  Lyapunove  function  of  the  interconnected  system 
with  state  (e,f),  then  Toa(e,£)  <  -  p||2  -  n(e).  Now  ioa(e,f)  =  0  =>-  Jr(e)  =  0,  so 
e  =  0.  So  in  this  case  £  =  a(£);  but  it  is  asymptotically  stable,  so  £(£)—>■  0  as  oo.  The 
interconnected  (e,£)  is  locally  asymptotically  stable  by  LaSalle’s  Theorem.  Now  if  (e,  £)  =  0 
then  x  =  /(x )  —  ffo(*)^i(^);  but  it  is  locally  asymptotically  stable  at  0  by  assumption  [A7], 
Thus,  we  can  conclude  that  this  closed  loop  system  is  asymptotically  stable  by  the  stability 
Theorem  for  hierarchical  systems([38]).  □ 


5  7ioo- Control:  Output  Feedback  Problems  and  Separation 
Principle 

We  now  consider  the  general  output  feedback  Hoo  control  problem.  The  solutions  to  this 
problem  are  based  on  the  reults  in  the  last  section. 

5.1  Solutions  to  Output  Feedback  Problems 

The  nonlinear  time-invariant  plant  is  realized  as  affine  state-space  equation: 

x  =  f{x)  +  gi(x)w  +  g2(x)u 
G  :  z  =  hi(x)  +  kX2{x)u 

y  =  h2(x)  -|-  k21(x)w 

where  /( 0)  =  0,  hj(0)  =  0,h2(0)  =  0;  x,  w,  u,  z,  and  y  are  assumed  to  have  dimensions  n, 
p2,  qi ,  and  q2,  respectively. 

The  following  assumptions  are  made: 

[A2]:  kf2(x)  [  hi(x)  k12(x)  ]  =  [  0  I  ]; 

[A»].  [*$]*£(.)=[?]; 

[A4]:  [hx(x),/(x)j  is  zero-state  detectable; 

[A5]:  [h2(x),  f(x)]  is  zero-state  detectable. 

The  solution  to  this  problem  is  related  to  the  following  two  HJIs 

dV  1  dV  m  F)VT 

Hfi(V,x)  :=  -<^(x)f(x)+-—(x)(g1(x)g1  (x)  -  g2(x)g?(x))-^-(x)  +  hj (x)h1(x)  <  0, 
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and 


Hfc(U,x )  :=  ~(x)f(x)  +  ~(*)^(*)^(*)^-(*)  +  hj(x)hi(x)  -  h%(x)h2(x)  <  0, 

Theorem  5.1  Consider  G,  if  there  is  some  if(x)  >  0  with  ip(0)  —  0  such  that 

(i)  there  exists  a  positive  definite  V (x)  which  solves  the  HJE:  Hfi(V,x)  +  ip(x)  =  0  with 

F(0)  =  0. 

(it)  there  exists  a  positive  definite  U(x)  which  satisfies  the  HJI:  'Hfc(U,  x)  +  'ip(x)  <  0 
with  U(0)  —  0.  And  Hfc(U,  x )  +  if(x)  has  nonsingular  Hessian  matrix  at  0. 

(in)  U (x)  —  V(x)  >  0  is  positive  definite.  And 

(^(*)  -  ^(x))Lo(x)  =  — 2*|*(a?), 
has  a  solution  L0(x). 

Then  the  Hca- control  problem  is  (locally)  solvable. 

Define 

1  t,  x dVT 

—  at  l  x 

2 

The  controller 


F0(x) 


1  dVT 


Fi(x)  :=  ^gj{x)i^(x). 


K  : 


«  =  /(®)  +  9x{x)Fi(x)  +  g2(x)FQ(x)  -f  L0(x)h2(x)  -  L0(x)y 
u  =  F0(x) 


(locally)  solves  the  Tt^-control  problem. 

Theorem  5.2  Consider  a  system  G  satisfying  the  condition  in  Theorem  5.1.  If  in  addition 
L1(x)  satisfies 

,811,  .  8V _ T,  . 

(g^(x)  ~  ff^(x))£i(x)  =  ~2hKx ). 

then  the  controller  u  —  H(M,Q)y  with  M  given  by 

x  =  f(x)  +  g2(x)F0(x)  +  gfi^Ffix)  +  Lo(x)hfix)  -  L0(x)y  +  (g2(x)  +  Lx(x  ))u0 

u  =  F0(x)  +  Uq 

{  y0  =  h2(x)  -  y 

for  all  Q  £  TQ  also  (locally)  solves  Hoo-control  problem  for  OE. 

The  main  idea  of  construction  is  to  convert  the  general  problem  OF  into  the  simpler 
problems  which  have  been  solved  if  possible. 

Let  V(x)  >  0  be  the  solution  for  Hfi(V,x )  =  0.  Define  new  variables  r  and  v  by 
1  T( 

r  w  —  -Sl  (x)-^-(x) 
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1  T  f  X dV  ,  N 

v  :=  u  +  -g2  (x)-^(x) 

now  we  get  a  new  system 

{x  =  ft{x )  +  gi(x)r  +  g2(x)u 

v  =  ht(x)  +  +  u 

y  =  h2(x)  +  k2i(x)r 

where 

ft(x)  =  f(x)  +  ~gf(x)gf(x)^(x) 
ht(x)  :=  ~\9l{x)^-{x) 

We  have  the  following  lemma. 

Lemma  5.3  Consider  systems  G  and  Gt.  If  the  controller  K  makes  £l(Gt,K)  have  C,2-gain 
<  1,  it  also  results  in  Q(G,  K)  having  C2-gain  <  1. 


Proof  Note  that  z  —  Cl(G,K)w  and  r  —  Q(Gt,  K)v. 
Since  V(x)  >  0  solves  Kfi(V,x )  +  'if(x)  =  0,  then 

dV 

V(x )  =  ~q^(x)U(x)  +  9i(x)w  +  g2(x)u) 


ni2+ihi2 


+ 


7p(x) 


<-lkll2  +  IHI2-IHI2  +  IIHI2 


So  for  all  T  >  0, 

f\\\wf  -  \\zf)dt  >  f(\\v\\2  -  ||r||2)dt  +  V{x(T))  >  j\\\v\\2  -  \\r\\2)dt. 

Jo  Jo  Jo 

Aimi2  -  imi2)*  >  o  =►  Aimi2  -  \\zf)dt  >  o. 

Jo  Jo 

□ 


Note  that  system  Gt  is  of  OE  structure  and  satisfies  the  structure  assumption  [A3], 
Define 


7 MW,x)  :=  —■  (x)ft(x)+  ^^-(x)gi(x)gf(x)^-(x)  +  hj(x)ht(x)  -h^(x)h2(x) 


4  dx 


dx 
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W(0)  =  0. 


Take  W( x)  =  U{x )  —  V{x)  with  W(0)  =  Z7(0)  —  V(0)  where  V(a:)  >  0  is  given  just  now. 
Note  that 

nt(W,x)  =  Hfc{U,x )  -  HFi(V,x)  =  nFC(U,x)  +  i>(x). 

Thus,  7it(W,x )  <  0  if  and  only  if  Hfc(U,x )  +  ip(x)  <  0.  Assume  JJ(x)  satisfies  assumption 
(2)  and  (3),  then  'Ht{W,  x)  also  has  negative  definite  Hessian  matrix  at  0. 

We  continue  the  proof  of  Theorem  5.1. 


Proof  of  Theorem  5.1.  Since  L0(x)  is  such  that 


dW 

dx 


(x)Lq(x)  =  —2  h^{x) 


The  controller  K  given  by  Theorem  4.10  as 


f  x  =  ft{x)  +  g2(x)ht(x)  +  L0(x)h2(x)  -  L(x)y 
\  u  =  ht(x) 


is  such  that  system  f l(Gt,K)  locally  has  C2- gain  <  1. 

And  by  lemma  5.3,  K  is  also  such  that  Cl(G,K)  has  £2-gain  <  1.  Note  that  K  is  exactly 
the  one  as  given  if  substituting  ft(x )  and  ht(x).  We  only  need  to  verify  the  stability. 

The  closed  loop  system  Q,(G,  K )  is 


x  =  f(x)  +  g2(x)F0(x)  +  gi(x)w 

<  'x  =  f  (x)  +  g^F^x)  +  g2(x)F0(x)  +  L0(x)(h2(x)  -  h2(x))  +  L0(x)k2i(x)w 
z  =  hi(x)  +  k12(x)F0(x) 

Take  e  =  x  —  x.  Note  that  •)  has  negative  definite  Hessian  matrix  as  does  'Hfc{U-)  *). 

Using  the  same  technique  as  in  the  proof  of  Theorem  4.8,  it  can  be  concluded  that  for  some 
locally  positive  definite  7r  :  E"  — >  E+,  such  that  if  (x,  x)  6  Bs  for  some  s  >  0 

W{e)  <  ||r||2  -  ||w||2  -  7r(e) 


Let  L(x,e)  —  V(x)  +  W(e)  with  e  =  x  —  x.  By  assumption  V(x)  and  W(e)  are  positive 
definite,  so  is  L(x,e),  and  it  can  be  used  as  a  Lyapunov  function.  Take  w  =  0, 


V(x)<-\\zf  +  \\v\\2-\\r\\2 


L(x,e)  =  V(x)  +  W(e) 

<  (-  Ikll2  +  Ihll2  -  Ikll2)  +  (Ikll2  -  IMI2  ~  <e))  =  -  |M|2  -  x(e)  <  0. 


Then  L{x,e)  =  0  ^  z  =  0  and  7r(e)  =  0  =>  x  —  0  and  e  =  0.  Therefore,  L(x,e )  is  locally 
negative  definite,  the  closed  loop  system  is  locally  asymptotically  stable.  □ 

Similar  arguments  to  Theorems  4.12  and  5.1  can  be  also  used  to  prove  Theorem  5.2. 


33 


Remark  5.1  In  the  previous  Theorems,  the  two  HJIs  are  decoupled.  Thus,  to  check  the 
conditions  just  needs  to  solve  the  two  parallel  HJIs  and  then  check  if  their  solutions  satisfy 
condition  (3). 

Remark  5.2  In  the  last  Theorem,  the  parameterized  controllers  are  nonlinear  fractional 
transformation  on  free  parameter  Q  e  TQ.  In  fact,  this  stable,  contractive  nonlinear  param¬ 
eter  Q  can  be  more  general,  say,  we  can  assume  it  has  the  following  realization 

q  .  f  i  =  <*(£>yo) 

’  \  «o  =  c(f ,  y0) 

And  £  =  a(£,  0)  is  locally  asymptotically  stable  at  0,  and  there  exists  £/q(£)  positive  definite 
and  smooth  such  that  Uq(£)  <  ||yo||  —  llMo||2- 

Remark  5.3  Note  that  the  sufficient  conditions  in  Theorem  5.1  are  equivalent  to  the  ones 
given  by  Isidori  [22],  although  the  approaches  are  basically  different.  In  [25,  22],  they  assumed 
the  controller  had  separation  structure,  and  gave  it  an  observer  form,  and  then  justified  it  by 
assuming  the  closed  loop  system  corresponds  a  HJI  which  can  guarantee  it  has  /Vgain  <  1; 
and  then  simplified  the  conditions  (see  [22]).  In  this  sense,  this  approach  is  synthesis.  In  this 
paper,  we  used  the  analysis  approach.  One  of  the  advantages  of  the  latter  approach  is  that 
it  can  provide  a  class  of  parameterized  Woo -controllers. 

Remark  5.4  Woo -controllers  have  separation  structures.  The  separation  principle  for  the 
Woo -performance  in  nonlinear  systems  was  first  confirmed  by  Ball-Helton-Walker[4,  5]  (see 
also  Isidori  [22]). 

5.2  Examples 

In  this  subsection,  we  will  examine  an  example  whose  solution  can  be  verified  in  another  way. 
The  basic  block  diagram  is  as  follows 


w  i  w2 


Where  P  is  the  nonlinear  plant;  K  is  the  controller  to  be  designed  such  that  the  output  z\ 
is  regulated;  y  is  the  measured  output,  based  on  which  the  control  action  u  is  produced; 
w2  is  the  disturbance  from  the  actuator;  and  w\  is  the  noise  from  the  sensor.  The  control 
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problem  is  to  design  the  controller  K  such  that  the  influence  of  the  noises  wx  and  u;2  on  the 
regulated  output  Z\  can  be  reduced  to  the  minimal  with  the  reasonable  effort  (control  action 
should  not  be  too  large). 

To  formulate  this  problem,  all  the  signals  are  considered  in  space  £2[0,oo).  Let  r  >  0, 
define 

7*(r)  =  inf{7  :  [  (\\zi\\2  +  r\\u\\2)dt  < -y2  [  ||2  -f  ||u;2||2)d/, VT  e  R+,forsomeI{} 

Jo  Jo 

The  Hoo-control  problem  in  this  setting  can  be  formulated  as:  Give  7  >  7 *(r),  find  K  such 
that 

/  (IM2  +  r|MI2)<ft<72  /  (IK||2  +  ||u>3||3)<ft,vr  G  R+ 

Jo  Jo 

In  this  example,  the  plant  has  the  following  realization: 

x  =  e*(u>2  +  u ) 

<  Zi  =  X  +  Wi 
y  -  x  +  wx 

We  will  consider  two  cases.  In  both  cases,  since  the  stability  of  the  resulting  closed  loop 
systems  can  be  easily  checked  by  using  the  corresponding  Theorems,  we  just  consider  the 
7foo -performances. 


Case  I:  r  =  0 

Consider  the  control  problem  that  a  controller  K  is  designed  such  that: 
/  M2*<7o/  (IMI2  +  |KI|2)<ft,VT  G  R+ 

Jo  Jo 

where  70  =  1  /( 1  —  e)  for  some  0  <  e  <  1 . 

To  standardize  the  problem,  take 


z  1  -  e)z! 


Thus,  the  state-space  realization  is: 

x  =  [  0  e*  w  +  exu 

<  z  =  (1  —  e)x  +  1  —  e  0  w 

y  —  x  +  1  0  w 

Change  the  variable  u'  —  exu.  Now  it  looks  like  the  output-injection  control  problem. 
But  it  is  not  standard,  since  we  need  to  get  ride  of  the  term  [  1  —  e  0  1  w  in  the  regulated 
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output  z.  By  the  simplification  procedure  we  assumed  in  the  proof  of  Theorem  3.1.  we  can 
get  the  simplified  system: 


r 

x  — 

[ 

0  ex  ]  w  + 

z  = 

V2e-e*X 

Vn  = 

7^x  + 

10  w 

with  ?/jv  =  \/2e  —  e2y.  Now  the  system  has  a  required  output-injection  structure. 
Consider  the  HJI  with  respect  to  this  structure: 

nFC(V,x)  =  || (*)  •  o  +  ■(*))’  +  <^=5i*)2  -  S  » 

A  class  of  positive  solutions  U(x)  are  such  that 


dU 

dx 


( x )  =  2 pe  Xx 


for  0  <  p  <  1.  Take  p  —  1,  the  solution  T(a:)  to 

2x 


is 


£(*)  = 


y/2e  - 


It  follows  that  the  controller  is 

e* 


u'  =  L(x)yN 


V2e 


V2c  —  e2y  =  —exy 


or  the  output-injection  can  be  recovered  as  u  —  —y.  Note  that  it  is  independent  of  e. 
This  Hoo  controller  is  identity  ( K  =  -1).  Actually,  we  have  following  general  result. 


Theorem  5.4  (Doyle  et  al.  [10])  Consider  the  feedback  system  as  shown.  Suppose  the  plant 
P  is  passive,  i.e. 

{Pefedt  >0,  VT  G  K+ 

and  K  =  —1,  then 

T  T 

f  \\z,\\2dt<  /  (IKII2  +  \\w2\\2)dt,VT  e  R+ 

J  0  Jo 
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Case  II:  r  =  1 

Consider  the  control  problem  that  a  controller  K  is  designed  such  that: 
/T(lki||2  +  IMI )d.t  <  Jo  AkH*  +  ||tn2||2)dt,VT  6  E+ 

JO  JO 

where  70  =  a/2/(1  —  e)  for  some  0  <  e  <  1. 

Take 


W! 

1  -  e 

Zl 

w 

w  2 

11 

u 

Thus,  the  state-space  realization  is: 


[  0  ex 

Irj  n 
v'S  U 

0  0 


z  = 

bix 

0 

+ 

y  =  x 

+ 

1  0 


w  + 
w  + 
w 


e  u 


0 

1  —  £ 

L  V2  J 


u 


To  standardize  this  structure,  by  the  procedure  we  assumed  in  the  proof  of  Theorem  3.1, 
we  can  get  the  simplified  system: 


x  = 

z  = 

Vn  = 


l-e 


■/T+2 


0 


0  e* 


w  + 


+ 


0 


l+2e-e2* 


-f  1  0  j  W 


1 


UN 


with  uN  =  and  yN  =  ^/1+2^~£2  y.  Now  the  system  has  a  required  output  feedback 

structure. 

Now  take  i/>( x )  =  0  as  in  Theorem  5.1.  Consider  HJE: 


2e2x  BV 

)(?W)2  +  ( 


The  positive  solution  F(x)  is  such  that 

-  V  c-.x 

rjx  ’~  i  +  2c-t‘ 

Also  consider  HJI: 


s/l  +  2c  -  e2 


a:)2  =  0. 


l-e 


WTO(C,*)  =  §£(*)•<>  +  ^(f^*))2  +  (  v/TT2F=7t 


*)2  -  (1 


1  +  2e  -  e: 


:xf  <  0 
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A  class  of  positive  definite  solutions  U(x )  are  such  that 
dU  ,  ^  o  - 

feW  =  2',e  1 

for  0  <  p  <  1.  They  make  HpC(U,  x)  have  negative  Hessian  matrix  at  0. 

Now  it  can  be  easily  checked  that  U(x)  -  V(x )  is  positive  definite  if  p  is  taken  to  be  close 
enough  to  1.  And  L0(x)  can  be  solved  by: 

C(x)  “  Sr(x))i«(x)  =  -2\Zi+2 I-?* 

Then  the  controller  can  be  constructed  by  Theorem  5.1. 
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